
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 

Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 



10/767,348 01/30/2004 Christopher R. Dance D/A3127 5238 



7590 08/28/2007 

Xerox Corporation 
Patent Documentation Center 
Xerox Square 20th Floor 
100 Clinton Ave. S. 
Rochester, NY 14644 



EXAMINER 
RUSH, ERIC 



ART UNIT | PAPER NUMBER 

2624 



MAIL DATE 



08/28/2007 



DELIVERY MODE 



PAPER 



Please find below and/or attached an Office communication concerning this application or proceeding. 



The time period for reply, if any, is set in the attached communication. 



PTOL-90A (Rev. 04/07) 



Office Action Summary 


Application No. 

10/767,348 


Applicant(s) 

DANCE ET AL. 


Examiner 

Eric Rush 


Art Unit 

2624 





•• The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S vResponsive to communication(s) filed on 22 June 2007 . 
2a)S This action is FINAL. 2b)D This action is non-final. 

3) Q Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-20 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Claim(s) 1-20 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) DThe specification is objected to by the Examiner 

10)^ The drawing(s) filed on 8 August 2003 is/are: a)S accepted or b)D objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)Q None of: 

1. D Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1) Notice of References Cited (PTO-892) 

2) O Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statement(s) (PTO/SB/08) 

Paper'No(s)/Mail Date . 

U.S. Patent and Trademark Office "~ ~ *~ "~ 

PTOL-326 (Rev. 08-06) Office 



4) ^ Interview Summary (PTO-413) 

Paper No(s)/Mail Date. 14 June 2007 . 

5) O Notice of Informal Patent Application 

6) □ Other: . 



Summary Part of Paper No./Mail Date 20070823 



Application/Control Number: 10/767,348 Page 2 

Art Unit: 2624 

DETAILED ACTION 

Claim Rejections - 35 (JSC § 101 

1 .. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

2. In view of the amendment received on 22 June 2007 the 35 U.S.C. 101 rejection 
of claim 1 8 is withdrawn. 

Claim Rejections - 35 USC § 102 

3. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

4. Claims 1 - 20 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Camara et al. U.S. Patent No. 7,197,158. 

With regards to claims 1 and 18-19: Camara et a I. each a method, a 
computer-readable medium comprising computer-executable instructions 
(Camara et al. Fig. 1, Column 3 Lines 21 - 27) and an apparatus for 
automatically combining a digital image with text data, comprising: 
(Camara et al. Column 2 Lines 41 - 44, metadata reads on text data) (a) a 
receiving means configured to receive electronic data comprising a digital 
image (Camara et al. Column 3 Lines 5-9, Column 5 Lines 49 - 54), (b) a 
classification means configured to automatically classify the image 
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according to a predetermined set of categories (Camara et al. Column 3 
Lines 38 - 42, Column 7 Lines 3 - 8, Column 7 Line 31 - Column 8 Line 
21); and (c) a selection means configured to automatically select text data 
from a repository that matches the category of the image according to a 
predetermined criterion; (Camara et al. Column 4 Lines 47 - 53, Column 
1 Lines 32 - 66) wherein (a), (b), and (c) are executed on one or more 
servers. (Camara et al., Fig. 1 , Elements 1 70 - 1 73, 1 80, 1 81 , and 1 85, 
Column 3 Lines 5-20 and Lines 27 - 35) 



With regards to claim 2: Camara et al. teach the method according to 
claim 1 , wherein the selected text data matches a predetermined recipient 
profile. (Camara et al. Column 1 1 Lines 44 - 57, Column 12 Lines 42 - 
54) 



With regards to claim 3: Camara et al. teach the method according to 
claim 2, wherein said selecting at (c) further comprises automatically 
selecting a recipient profile according to a predetermined criterion. 
(Camara et al. Column 1 1 Lines 59 - 66) 



With regards to claim 4: Camara et al. teach the method according to 
claim 3, wherein the predetermined criterion is the sender of the electronic 
data. (Camara et al. Column 11 Line 28 - Column 12 Line 21, Camara et 
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al. disclose using metadata already present in the image file to further 
generate or supplement metadata Column 1 1 Lines 59 - 63 and this data 
can include author information Column 1 Lines 20 - 24 i.e. sender 
information) 

With regards to claim 5: Camara et al. teach the method according to 
claim 1 , further comprising automatically combining the image and the 
selected text data to form a combined document. (Camara et al. Column 2 
5 • Lines 41 -44, Column 7 Lines 3-7) 



ft - With regards to claim 6: Camara et al. teach the method according to 

** 

if claim 1 , further comprising at least one of automatically initiating printing 

i 

] of the combined document and sending the combined document. (Camara 

S et al. Fig. 3 Elements 310 and 312, Column 10 Lines 49 - 59) 



With regards to claim 7: Camara et al. teach the method according to 
claim 1 , wherein said receiving at (a) comprises receiving the electronic 
data over a network via at least one of electronic mail and a digital 
telephone network. (Camara et al. Column 5 Lines 9-45 and Column 5 
Lines 49 - 59) 
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With regards to claim 8: Camara et al. teach the method according to 
claim 1 , wherein said receiving at (a) further comprises requesting and 
receiving at least one of a recipient name and a recipient profile. (Camara 
et al. Column 6 Lines 40 - 46) 

With regards to claim 9: Camara et al. teach the method according to 
claim 1 , wherein said receiving at (a) further comprises testing the 

i 

electronic data regarding at least one of authentication, authorization with 
respect to a potential recipient, and content of the image. (Camara et al. 
Column 7 Line 64 - Column 8 Line 15) 

With regards to claim 10: Camara et al. teach the method according to 
claim 1 , wherein said classifying at (b) is preceded by automatically 
placing the electronic data on a queue or schedule for classification. 
(Camara et al. Fig. 3 Column 8 Lines 36 - 45 Lines 59 - 62, Column 9 
Lines 6-9 Lines 1 5 - 22 and Lines 34 - 45) 

With regards to claim 1 1 : Camara et al. teach the method according to 
claim 1, wherein the text data in the repository is classified according to 
the predetermined set of categories (Camara et al. Fig. 4 Elements 416a- 
d) and wherein said selecting at (c) further comprises selecting text data 
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being classified in the same category as the image. (Camara et al. 
Column 1 1 Line 41 - Column 12 Line 6) 

With regards to claim 12: Camara et al. teach the method according to 
claim 1 , wherein said selecting at (c) further comprises searching the 
repository for text data comprising a keyword associated with the category 
of the image. (Camara et al. Column 7 Line 49 - Column 8 Line 21) 

With regards to claim 13: Camara et al. teach the method according to 
claim 1 , wherein said selecting at (c) further comprises classifying the 
image according to a predetermined set of subcategories within a 
category. (Camara et al. Column 8 Lines 6-12) 

With regards to claim 14: Camara et al. teach the method according to 
claim 1 , wherein the electronic data further comprises image content 
information data (Camara et al. Column 7 Lines 49 - 63) and wherein said 
classifying at (b) further comprises extracting the image content 
information data. (Camara et al. Column 7 Lines 3-7) 

With regards to claim 15: the method according to claim 14, wherein the 
image content information data comprises one or more of positional and 
temporal information regarding the image (Camara et al. Column 1 1 Lines 
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41 - 58), and wherein said classifying at (b) further comprises comparing 
at least one of the position and temporal information with a lookup table. 
(Camara et al. Column 1 1 Line 59 - Column 1 2 Line 1 1 ) 

With regards to claim 16: Camara et al. teach the method according to 
claim 1, wherein said classifying at (b) further comprises extracting 
content information from the image. (Camara et al. Column 8 Lines 6-15) 



With regards to claim 17: Camara et al. teach the method according to 
claim 16, wherein extracting content information from the image comprises 
applying at least one of a kernel image categorization method and a multi- 
classifier method. (Camara et al. Fig. 4 Column 8 Lines 2-15, Column 1 1 
Line 59 -Column 12 Line 11) 

With regards to claim 20: Camara et al. teach the apparatus according to 
claim 19, further comprising a combining means configured to 
automatically combine the image and the selected text data to form a 
combined document. (Camara et al. Fig. 1 Column 3 Lines 5 - 20) 

Response to Arguments 

5. Applicant's arguments filed 22 June 2007 have been fully considered but they are 
not persuasive. In page 7 of the remarks, regarding claims 1,18, and 19, and 
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dependent claims thereof. Applicant's representative argues that Camara et al. does not 
teach or suggest implementation of their method and system for automatically 
combining a digital image with text data to be executed on one or more servers. The 
examiner respectfully disagrees. Camara et al. teach, by way of Fig. 1 , elements 170, 
171, 172, 173, 180, 181, and 185, as well as in column 3 lines 5-20 and lines 27-35, 
that their method and system for generating and integrating metadata into images may 
be executed on one or more servers. Accordingly, and as set forth in the 102 rejection 
above, Camara et al. do teach the limitations of claims 1,18, and 19. 

Conclusion 

6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Eric Rush whose telephone number is (571) 270-3017. 
The examiner can normally be reached on 7:30AM - 5:00PM (EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Samir Ahmed can be reached on (571) 272-7413. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




